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CHAPTER  I 


PURPOSE  OP  INVESTIGATION 

The  purpose  of  this  investigation  Is  to  compare  the 
results  of  an  objective  test  in  History  II  with  the  results 
of  a  regular  Departmental,  that  is,  essay  test,  on  the  same 

subject  . 

Such  an  investigation  should  serve  to  throw  some 
light  upon  the  following  points : 

1.  The  relative  validity  of  each  type  of  examination. 

2.  The  extent  to  which  objective  tests  correlate  with 

Departmental  examinations. 

3.  The  significance  of  the  average  marks  in  each  test. 

4.  The  significance  of  the  number  of  very  high  marks 

as  well  as  the  number  of  failures  in  each  paper. 

5.  The  parts  of  the  objective  test  which  seem  most 
valuable  for  examination  purposes. 

6.  The  significance  of  the  distribution  of  marks. 
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CHAPTER  II 

THE  METHODS  OF  SECURING  DATA 

The  1931  Grade  X  History  Examination  for  the  Province 
of  Alberta  was  divided  into  two  parts;  firstly,  the  regular 
Departmental  examination  of  two  hours1  duration,  consisting 
of  essay  type  questions;  and  secondly,  the  new  type  or* 
objective  test  of  one  hour’s  duration,  composed  of  true -false, 
completion,  multiple  choice,  and  matching  tests.  The  marks 
made  by  the  pupils  on  each  of  the  papers  mentioned  above 
were  tabulated  on  cards  provided  for  that  purpose . 

Two  thousand  cases  in  all  were  considered.  For  con¬ 
venience  these  were  divided  into  groups  of  400  each,  which 
will  hereafter  be  referred  to  as  Series  I,  Series  II,  Series 
III,  Series  IV  and  Series  V.  Every  mark  made  on  each  test 
by  each  of  the  2,000  pupils  was  tabulated  on  the  Ruch  and 
Stoddard  correlation  sheets .  As  these  sheets  are  of  a 
limited  size,  suitable  intervals  were  used;  0-4,  5-9,  etc,, 
for  the  Departmentals  and  for  the  mark  made  on  the  whole 
objective  test ,  Smaller  intervals  were  used  as  convenience 
dictated  for  various  parts  of  the  objective  test.  The  marks 
of  the  pupils  in  Series  I,  II  and  III  are  the  marks  of 
Grade  X  pupils;  those  in  Series  IV  and  V  are  the  marks  of 
Grade  XI  pupils . 

On  the  correlation  sheets  comparisons  were  made 
between  the  following  tests: 


» 
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1.  Department a Is  vs  True -False 

2.  Departmentals  vs  Completion 

3.  Departmentals  vs  Multiple  Choice 

4.  Departmentals  vs  Matching 

5.  True -False  vs  Remainder  of  Objective  Test 

6.  Completion  vs  Remainder  of  Objective  Test 

7.  Multiple  Choice  vs  Remainder  of  Objective  Test 

8.  Matching  vs  Remainder  of  Objective  Test 

9.  Departmentals  vs  Total  Objective  Paper 

Since  each  of  these  correlations  applied  to  five 
series  of  four  hundred  cases  each  the  whole  process  involved 
the  completion  of  forty -five  correlation  sheets. 

Suppose,  for  example,  that  the  Departmentals  are 
being  compared  with  the  true-false  tests.  The  sheets  con¬ 
cerned,  when  completed,  give  the  mean  for  each  test,  the 
standard  deviation  in  each  case,  and  the  correlation  between 
the  Departmental  marks  and  the  true -false  marks  along  with 
the  probable  error  for  this  last  computation.  The  probable 
error  for  the  mean  and  for  the  standard  derivation  will  be 
found  in  separate  tables.  Similar  computations  have  been 
made  on  each  of  the  forty-five  sheets. 

Copies  of  the  Departmental  examination  and  of  the 
objective  test  are  attached.  They  are  self-explanatory. 


HIGH  SCHOOL  AND  UNIVERSITY 
MATRICULATION  EXAMINATIONS  BOARD. 

DEPARTMENTAL  EXAMINATIONS,  1931. 


HISTORY  2. 
PAPER  I. 


Time — Two  hours. 


Note. — Five  questions  only  are  to  be  answered,  not  more  than  two 
being  taken  from  any  one  section. 

SECTION  A. 

Values. 

20  1.  Why  did  Henry  VII  establish  the  Court  of  the  Star 

Chamber? 

What  services  did  it  render  in  his  reign? 

20  2.  Describe  the  voyages  of  either  Frobisher  or  Drake. 


3.  State  briefly  the  circumstances  that  brought  about  the 
passing  of  the  Petition  of  Right. 

What  were  its  chief  provisions? 

Indicate  its  importance. 


20  4.  T  race  the  developments  in  the  reign  of  James  II 

which  led  to  the  Revolution  of  1688. 


SECTION  B. 

20  5.  Tell  how  the  Union  of  England  and  Scotland  was 

effected  in  1707,  indicating  the  advantages  secured 
by  each  country. 


9  6.  What  was  Pitt’s  policy  during  the  Seven  Years’  War? 

7  What  were  the  terms  of  the  Treaty  of  Paris  of  1768 


which  affected  North  America? 

Why  was  Pitt  not  satisfied  with  this  treaty? 


[over] 


Values. 

20  7.  What  were  the  causes  of  friction  between  England 

and  the  Colonies  in  the  reign  of  George  III? 

20  8.  Describe  the  reform  legislation  of  the  First  Parliament 

held  under  the  Reform  Act  of  1832. 

SECTION  C. 

20  9.  Trace  the  career  of  Sir  Robert  Peel  with  particular 

reference  to  the  Corn  Law  legislation. 

20  10.  Disraeli  was  Prime  Minister  of  England  from  1874  to 

1880.  Describe  either  the  social  legislation  or  the 
foreign  policy  and  relationships  of  this  period. 

20  11.  Summarize  the  careers  and  achievements  of  tivo  of  the 

following  statesmen : 

John  Bright. 

W.  E.  Gladstone. 

Lord  Palmerston. 

H.  H.  Asquith. 

Earl  of  Balfour. 


100 


HISTORY  2. 

PAPER  II. 

Time — One  hour. 

PART  I.  —  TRUE  -  FALSE  PROBLEMS. 

DIRECTIONS.  —  If  you  think  the  statement  in  each  of  the  following  is 
true,  underline  the  word  TRUE ;  if  you  think  it  is  false,  underline  the  word 

I  FALSE ;  if  you  are  not  sure  about  a  statement,  omit  it. 

Examples:  Napoleon  was  defeated  at  Waterloo .  True  False 

The  World  War  was  ended  in  1917 .  True  False 

1.  The  professionalizing  of  the  army  struck  a  blow  at  the  Feudal 

system .  True  False 

2.  The  Court  of  Star  Chamber  was  established  by  Henry  VIII.  True  False 

3.  The  religious  changes  under  Henry  VIII  made  England  Pro¬ 
testant  . True  False 

4.  Parliament  assented  readily  to  all  the  policies  of  Elizabeth.  .  True  False 

5.  The  chief  interest  of  government  under  the  Tudors  concern¬ 
ed  the  religious  question  ;  whereas  under  the  Stuarts  the  chief 
interest  was  in  constitutional  questions .  True  False 

6.  James  I  accepted  willingly  Parliament’s  decision  in  foreign 

affairs . True  False 

7.  The  Judges  supported  the  King  in  the  Five  Knights’  case.  .  True  False 

8.  The  effective  governing  power  during  the  Commonwealth 

was  the  army .  True  False 

9.  The  Instrument  of  Government  provided  for  a  parliament  of 

two  chambers .  True  False 

10.  The  Navigation  Act  of  Cromwell’s  Parliament  brought  about 

friendly  relations  between  England  and  Holland .  True  False 

11.  Charles  II  was  the  first  English  sovereign  to  tackle  seriously 

the  problem  of  vagrancy .  True  False 

12.  The  Clarendon  Code  aimed  at  the  suppression  of  Roman 

Catholic  and  Puritan  non-conformity .  True  False 

13.  In  the  struggle  over  the  Exclusion  Bill,  the  two  parties  of 

English  politics,  Whig  and  Tory,  definitely  emerge .  True  False 

14.  James  II’s  Declaration  of  Indulgence  was  an  indication  that 

he  believed  in  religious  toleration .  True  False 

15.  The  Bill  of  Rights  provided  that  the  sovereign  might  he  of 

any  faith .  True  False 

• 

16.  In  the  reign  of  George  I,  the  Whigs  stressed  the  importance 

in  the  state  of  “Church  and  King” . ' .  True  False 

17.  Walpole  enforced  the  Navigation  Acts  against  the  American 

Colonies . True  False 


18.  The  opposition  under  Pitt  used  the  war  cry  to  drive  Walpole 

from  office .  True  Fals< 

19.  The  American  Revolution  was  caused  partly  by  George  Ill’s 

anxiety  to  maintain  what  he  considered  to  be  his  rights . True  Fals< 

20.  France  and  Spain  supported  the  American  Revolution  be¬ 
cause  they  believed  in  colonial  self-government .  True  Falsi 

21.  The  Industrial  Revolution  was  the  change  from  machine  in¬ 
dustry  to  handicrafts .  True  Falsi 

22.  In  the  Agricultural  Revolution  the  population  of  English 

villages  increased  because  of  changes  in  methods  of  cultiva¬ 
tion .  True  Fals< 

23.  Britain  declared  war  on  France  in  1793  to  compel  the  restora¬ 
tion  of  the  French  monarchy .  True  Falsi 

24.  Pitt  granted  religious  freedom  to  the  Irish  by  the  Act  of 

Union  of  1800 .  True  Falsi 

25.  Pitt  the  Younger  abolished  pocket  boroughs  in  England.  .  . .  True  Falsi 

26.  The  Congress  of  Vienna  restored  most  of  the  states  of  Europe 

as  they  had  existed  before  the  advent  of  Napoleon .  True  Falsi 

27.  The  restoration  of  the  gold  standard  in  England  in  1819  in¬ 
jured  the  credit  of  the  country .  True  Falsi 

28.  The  Factory  Acts  of  1833  limited  the  working  day  to  eight 

hours .  True  Falsi 

29.  Prussia  signed  the  treaty  of  Belgian  neutrality  in  1839 . True  Falsi 

30.  The  Chartists  asked  for  payment  of  members  of  Parliament 

out  of  public  funds .  True  Falsi 

31.  The  greater  part  of  the  People’s  Charter  was  gradually  in¬ 
corporated  in  the  law  of  the  land .  True  Falsi 

32.  Turkey  was  the  ally  of  Britain  during  the  Crimean  War  ...  True  Falsi 

33.  British  success  in  the  Crimean  War  was  due  to  the  adminis¬ 
tration  of  Lord  Aberdeen .  True  Falsi 

34.  The  Education  Act  of  1870  provided  wholly  free  education.  True  Falsi 

35.  The  Earl  of  Balfour  was  a  convinced  Home  Ruler .  True  Falsi 


PART  II.  —  COMPLETION  PROBLEMS. 


DIRECTIONS. — Fill  in  each  blank  in  the  following  sentences  and  para¬ 
graphs  with  a  word  or  the  words  that  will  in  each  case  make  the  statement 
historically  true. 

1.  The  Roman  Catholic  reaction  under . was 

characterized  by  bitter  religious  persecution.  Hundreds  of  people  were 

burned  at  the  stake ;  notably  one  archbishop, . 

and  two  bishops . .  and . 

2.  Among  the  great  seamen  of  Elizabeth’s  reign  were  the  following: 

. ,  who  opened  up  the  slave  trade 

between  Africa  and  the  American  plantations  ; . 

who  was  the  first  English  mariner  to  sail  around  the  world ;  and . . 

.  . ,  who  explored  the  straits  leading  into 

Hudson’s  Bay. 

3.  Charles  I,  during  the  period  of  his  personal  rule,  found  it  necessary  to 

levy  an  old  emergency  tax  known  as . 

in  order  to  make  his  income  balance  expenditure.  Opposition  to  this  levy 

centred  in  a  Buckinghamshire  squire  by  the  name  of . 

4.  Charles  II  of  Spain  left  his  inheritance  to . 

Louis  XIV  at  once  accepted  the  gift  for  his  grandson.  This  meant  that 

. and . would  now  be 

ruled  by  members  of  the  same  house.  England  considered  that  this  union 

affected  the . ,  which  she 

considered  necessary  to  the  peace  of  Europe. 

5.  The  younger . established  a  sinking  fund 

for  paying  off  ultimately  the . 

6.  The  Radicals  of  1815-30  were  found  chiefly  among  the . 

classes;  their  immediate  aims  were  to  get  the . 

extended  to  the  masses,  and  to  obtain  the  abolition  of . 

7.  The  British  first  went  to  India  as  traders  and  formed  in  1600  the . 

. Company.  Their  trade  rivals 


were  the . The  foundations  of 

British  rule  in  India  were  laid  by . who  avenged 

the  cruelty  at . by  his  victory  at 


In  1858  the  government  of  India 


was  transferred  to  the 


8.  Gladstone  decided  to  settle  the  Irish  question  by  granting . 

. to  Ireland.  By  this,  Ireland  would  be  given 


what  she  demanded  and  the . would 

no  longer  be  in  the . to  upset  the 

balance  of  parties  there. 


9.  The  Treaty  of  Versailles,  1919,  established  a . 

to  prevent . by  peaceful  settlement  of  disputes. 

The  Assembly  meets  every  year  at . The  founding 

of  the  organization  was  largely  due  to . 

10.  The  Imperial  Conference  of  1926  recognized  that  the  dominions  and  the 

mother  country  all  have .  . of  status, 

each  with  its  own  independent  government.  The  common  political  bond 

is  the .  . who  acts  in  each 

dominion  through  a .  . on  the 

advice  of  the  Prime  Minister  of  that  dominion. 


PART  III.  —  MULTIPLE  CHOICE  PROBLEMS. 


DIRECTIONS.  —  Below  are  seventeen  incomplete  sentences.  Each  is  fol¬ 
lowed  by  three  items,  one  only  of  which  can  be  used  to  complete  the  sentence 
correctly.  Underline  the  item  which  correctly  completes  the  sentence  in  each 
case. 

Example:  The  Battle  of  Waterloo  was  fought 

(1)  in  1730. 

(2)  between  the  English  and  French. 

(3)  between  the  Russians  and  Spaniards. 

1.  The  Renaissance  began  in  England  about  the  year 

(1)  1400. 

(2)  1500. 

(3)  1600. 

2.  The  Tudors  were  able  to  exercise  almost  despotic  power  after  the  Wars  of 
the  Roses  because 

(1)  many  of  the  powerful  nobles  had  perished. 

(2)  Parliament  gave  them  special  privileges. 

(3)  the  Great  Charter  had  been  repealed. 

3.  Martin  Luther  began  his  revolt  against  the  Roman  Catholic  Church 

(1)  toward  the  end  of  the  reign  of  Elizabeth. 

(2)  about  the  time  of  the  Petition  of  Right. 

(3)  about  thirty  years  after  Columbus  discovered  America. 

4.  The  fact  that  Thomas  Wolsey  failed  to  get  IPenry  VIII  a  divorce  from 
his  wife  Katherine,  is  important  in  English  History  because 

(1)  it  led  to  the  death  of  Wolsey. 

(2)  it  led  to  the  establishment  of  the  English  Church. 

(3)  it  caused  Thomas  More  to  become  Chancellor. 

5.  Henry  VIII  caused  the  monasteries  to  be  dissolved  because 

(1)  he  wanted  the  wealth  which  these  monasteries  possessed. 

(2)  he  disliked  some  of  the  doctrines  that  were  being  taught  in  the 
monasteries. 

(3)  the  monasteries  were  withholding  lands  from  cultivation. 

6.  The  Scottish  Reformation  differed  remarkably  from  the  English  in  that 

(1)  it  was  much  less  violent. 

(2)  it  had  the  whole-hearted  support  of  the  Queen. 

(3)  it  was  imposed  by  the  people  upon  the  Crown. 


7.  The  Civil  War  in  England  started  in 

(1)  1625. 

(2)  1642. 

(3)  1649. 

8.  The  Scottish  people  decided  in  1703  to  found  an  independent  nation 

because 

(1)  they  did  not  trust  Queen  Anne. 

(2)  they  wished  to  unite  with  France. 

(3)  in  matters  of  trade  they  were  treated  by  England  as  a  foreign 
country. 

9.  The  acquittal  of  the  seven  bishops  showed  that 

(1)  the  people  objected  to  the  Exclusion  Bill. 

(2)  the  judges  did  not  support  James’  setting  aside  the  Test  Act. 

(3)  the  University  of  Oxford  was  opposed  to  the  King. 

10.  The  Bill  of  Rights 

(1)  gave  freedom  of  speech  and  freedom  of  the  press. 

(2)  gave  wider  representation  in  the  House  of  Commons. 

(3)  reaffirmed  the  fundamental  rights  of  the  English  people. 

11.  William  III  employed  the  whole  power  of  England 

(1)  to  make  permanent  the  Reformation  Settlement. 

(2)  to  establish  parliamentary  government. 

(3)  to  save  Holland  from  Spain. 

12.  When  Walpole  lost  the  confidence  of  the  public 

(1)  he  was  impeached  by  Parliament. 

(2)  he  was  elevated  to  the  peerage. 

(3)  he  was  driven  into  exile. 

13.  The  British  success  in  the  Seven  Years’  War  was  due  to 

(1)  the  assistance  of  Prussia. 

(2)  the  aggressive  policy  of  the  Earl  of  Chatham. 

(3)  the  indifference  of  the  French. 

14.  The  Reform  Bill  of  1832  passed  the  House  of  Lords  because 

(1)  the  peers  feared  the  people  would  revolt. 

(2)  the  King  promised  to  create  new  peers  if  the  House  failed  to  pass  it. 

(3)  the  Duke  of  Wellington  believed  in  it. 


15.  Peel  resigned  in  1846  because 

(1)  the  Whigs,  who  had  supported  him  in  one  measure,  would  not  con¬ 
tinue  to  support  a  Tory  government. 

(2)  there  was  strong  agitation  in  the  country  against  the  repeal  of  the 
Corn  Laws. 

(3)  Gladstone  opposed  him. 

16.  The  Eastern  Question  of  1 854  was  concerned  with 

(1)  the  disputed  claims  of  Great  Britain  and  Russia  in  Afghanistan. 

(2)  the  control  of  the  Suez  Canal. 

(3)  the  possessions  of  Turkey. 

17.  The  Concert  of  Europe  was 

(1)  the  understanding  among  the  European  States  regarding  their 
possessions  in  Africa. 

(2)  the  meeting  of  the  European  Powers  to  settle  international  affairs. 

(3)  the  agreement  of  the  European  Nations  on  the  question  of  disarma¬ 
ment  following  the  War  of  1914. 


PART  IV.  —  MATCHING  PROBLEMS. 

X.  Below  is  a  list  of  EVENTS  “A’  followed  by  a  list  of  DALES  B  ..  lor 
each  event  in  List  “A”  there  is  a  correct  date  in  List  “B".  Record  in  the 
blank  following  each  event  in  List  “A”  the  number  of  its  correct  date  in 
List  “B”. 

Example:  In  the  blank  following  the  first  event  the  number  “15”  appears,  be¬ 
cause  the  correct  date  of  that  event  is  number  “15”. 

Match  the  remaining  items  in  the  same  way. 


“A”  EVENTS. 

(a)  Beginning  of  the  Great  W  ar. 

( b )  American  Colonies  declared  their  independence. 

(c)  Execution  of  Charles  I. 

( d )  Accession  of  Henry  VII. 

(e)  Peace  of  Paris  (Close  of  Seven  Years’  War) 

(/)  Waterloo. 

(g)  Repeal  of  Corn  Laws. 

(h)  Treaty  of  Utrecht. 

( i )  Petition  of  Right. 

(?)  Third  Reform  Bill. 

(k)  Outbreak  of  the  French  Revolution. 

(/)  Armistice  at  the  close  of  the  Great  War. 

(m)  Defeat  of  the  Spanish  Armada. 

“B”  DATES. 

(1)  1485  (5)  1649  (9)  1768 

(2)  1538  (6)  1660  (10)  1776 

(3)  1588  (7)  1713  (11)  1789 

(4)  1628  (8)  1745  (12)  1815 


Number.  .15 
Number.  .  .  . 
Number.  .  . . 
Number.  . . . 
Number .... 
Number.  . . . 
Number. . . . 
Number.  .  .  . 
Number. . . . 
Number. . .  . 
Number.  .  . . 
Number. . . . 
Number. . . . 

(13)  1846 

(14)  1885 

(15)  1914 

(16)  1918 


2.  Below  is  a  list  of  PROVISIONS  “A”  followed  by  a  list  of  ACTS  or 
TREATIES  “B”.  In  the  blank  following  each  of  the  items  in  List  “A” 
write  the  number  of  the  item  in  List  “B”  that  can  correctly  be  associated 
with  it. 

Example-.  The  first  item  in  List  “A”  is  correctly  marked,  because  the 
“Act  of  Supremacy”  “made  the  sovereign  the  Supreme  Head 
of  the  Church  of  England”  and  the  “Act  of  Supremacy”  is  item 
number  2  in  List  “B”. 

“A”  PROVISIONS. 

(a)  It  made  the  sovereign  Supreme  Head  of  the  Church 

of  England.  Number .  .  2  .  . 

( b )  It  required  all  church  services  to  follow  Prayer- 

Book  routine.  Number . 

(c)  It  made  it  illegal  to  billet  soldiers  in  private  houses 

in  time  of  peace.  Number . 


(d)  It  defined  the  Protestant  succession  on  the  death 

of  Anne.  Number. 

(e)  It  aimed  at  the  repression  of  non-conformity.  Number. 

(/)  It  prevented  parliaments  of  indefinite  length,  like 

the  Long  Parliament.  Number. 

( g )  It  provided  for  army  discipline.  Number. 

(h)  It  curtailed  the  powers  of  the  House  of  Lords.  Number^ 

( i )  It  required  a  gaoler  to  show  cause  in  court  for  de¬ 
taining  a  prisoner.  Number . 

(j)  It  extended  the  franchise  to  the  middle  class.  Number. 

( k )  It  gave  a  vote  to  all  householders  in  towns.  Number. 

(l)  It  provided  a  good  system  of  land  purchase  for  the 

Irish.  Number . 

(m)  It  made  it  illegal  to  sue  Trade  Unions  for  offences 

of  their  officials.  Number. 

(n)  It  increased  England’s  trading  rights  in  America.  Number. 


B”  ACTS  or  TREATIES. 


(1)  Treaty  of  Utrecht. 

(2)  Act  of  Supremacy. 

(3)  The  Second  Reform  Act. 

(4)  Clarendon  Code. 

(5)  Act  of  Settlement. 

(6)  Habeas  Corpus  Act. 

(7)  Petition  of  Right. 


(8)  Triennial  Act. 

(9)  Wyndbam  Act. 

(10)  Mutiny  Act. 

(11)  Act  of  Uniformity. 

(12)  Parliament  Act. 

(13)  Trades  Disputes  Act  (1906). 

(14)  Reform  Act  of  1832. 


3.  Below  is  a  list  of  PERFORMANCES  “A”  followed  by  a  list  of  NAMES 
“B”.  In  the  blank  following  each  of  the  items  in  List  “A”  write  the 
number  of  the  item  in  List  “B”  that  can  correctly  be  associated  with  it. 

Example:  The  first  item  in  List  “A”  is  correctly  marked  because  Mac¬ 
adam  “built  good  roads  in  England”  and  “Macadam”  is  item 
number  8  in  List  “B”. 


“A”  PERFORMANCES. 


(a)  He  built  good  roads  in  England. 

( b )  He  brought  about  the  restoration  of  Charles  II. 

(c)  He  opposed  the  Spanish  on  the  seas. 

(d)  He  formed  a  political  party  in  opposition  to  the 
King. 

( e )  He  recovered  the  Sudan  for  England. 

(/)  He  defeated  the  army  of  Napoleon. 

(g)  He  was  a  member  of  the  Anti-Corn  Law  League. 

( h )  Lie  wrote  “The  Wealth  of  Nations”. 


Number.  .  8  .  . 

Number . 

Number . 

Number . 

Number . 

Number . 

Number . 

Number . 


1 


(i)  He  was  instrumental  in  having  slavery  abolished. 

(j)  He  led  the  British  forces  in  the  War  of  the  Spanish 
Succession. 

( k )  He  used  violent  measures  to  put  down  opposition 
to  his  sovereign. 


Number 

Number 

Number 


“B”  NAMES. 


(1)  Marlborough 

(2)  Judge  Jeffreys 

(3)  General  Monk 

(4)  Wellington 

(5)  Francis  Drake 


(6)  Wilberforce 

(7)  Adam  Smith 

(8)  Macadam 

(9)  Cobden 

(10)  Kitchener 

(11)  Shaftesbury 


4.  Below  is  a  list  of  WARS  “A”  followed  by  a  list  of  CAUSES  “B”.  In  the 
blank  following  each  of  the  items  in  List  “A"  write  the  number  of  the 
item  in  List  “B”  that  can  correctly  be  associated  with  it. 

Example:  The  first  item  in  List  “A  is  correctly  marked  because  the 
“Secret  Treaty  of  Dover”  caused  the  “Dutch  Wars”,  and  the 
“Secret  Treaty  of  Dover”  is  item  number  4  in  list  “B”. 


“A”  WARS. 


(a) 

Dutch  Wars.. 

Number. 

(6) 

War  of  Spanish  Succession. 

Number. 

(c) 

American  Revolution. 

Number. 

(d) 

Great  War. 

Number . 

(0 

Second  Boer  War. 

Number . 

(/) 

Great  Rebellion  in  Stuart  Period. 

Number . 

(9) 

Seven  Years’  War. 

Number . 

(h) 

Spanish  Armada. 

Number. 

(i) 

Revolution  of  1688 

Number . 

(1 

Jacobite  Rebellion  of  1715 

Number . 

“B”  CAUSES. 

(1)  Religious  policy  of  James  II. 

(2)  Stamp  Act. 

(3)  Violation  of  Belgian  neutrality. 

(4)  Secret  Treaty  of  Dover. 

(5)  Divine  Right  of  Kings. 

(6)  Accession  of  George  I. 

(7)  Louis  XIV’s  decision  to  break  the  Second  Partition  Treaty. 

(8)  Execution  of  Mary  Stuart. 

(9)  Kruger’s  Ultimatum. 

(10)  Colonial  rivalry  of  France  and  England. 
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CHAPTER  III 

GENERAL  CRITICISMS  OP  TESTS 

The  Departmental  test,  as  conducted  in  the  year  1931, 
erred  in  being  over-generous  in  the  allotment  of  marks  for 
various  questions.  Question  1  on  this  paper  assigned  twenty 
marks  to  a  discussion  of  the  Court  of  the  Star  Chamber,  a 
subject  which  is  treated  very  briefly  in  the  text .  Another 
question  gave  ten  marks  for  information  concerning  John 
Bright,  whose  name  scarcely  appears  in  the  text.  Other 
questions,  covering  several  pages  of  the  text,  were  allowed 
only  the  same  number  of  marks.  Here,  obviously,  was  an 
unbalanced  type  of  examination.  It  would  almost  seem  reason¬ 
able  to  suppose  that  equal  marks  should  be  assigned  to  equal 
amounts  of  information. 

The  objective  test  is  likewise  open  to  certain 
general  criticisms.  Dealing  first  of  all  with  the  true- 
false  questions  we  find  that; 

Item  3  of  this  test  should  read  '’made  England  Protest¬ 
ant  in  doctrine".  The  statement  appearing  on  the  test  is 
rather  ambiguous ,  because  under  Henry  VIII  England  did  become 
Protestant  in  certain  respects  . 

Item  8  is  unsatisfactory  because  Cromwell,  could  not 
govern  England  effectively  without  the  army,  while  the  army 
could  not  govern  without  Cromwell. 

Item  15  is  not  of  sufficient  importance  to  warrant 
its  appearance  on  an  examination. 
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Item  21  is  obviously  false . 

Item  23  concerns  Lord  Aberdeen  who  is  not  one  of  the 
outstanding  men  in  British  history. 

The  completion  problems'  were  well  stated  and  dealt 
with  major  historical  issues.  However,  the  extreme  difficulty 
of  making  such  problems  wholly  objective  in  nature  is  well 
illustrated  by  Problem  No.  4  which  might  be  answered  correctly 
in  several  ways  .  Again  the  number  of  problems  submitted  in 
the  test  seems  rather  limited. 

The  multiple  choice  problems  on  the  whole  were  very 
good.  There  were  three  or  four  exceptions. 

Item  1  is  faulty  because  there  are  two  separate  Ideas 
involved:  the  time  and  the  combatants.  One  of  these  ideas 
would  have  been  suf f ic lent . 

Item  5  is  weak  because  all  choices  complete  the  topic 
sentence  correctly. 

Item  11  Is  quit©  indefinite . 

Item  12  is  not  important  becaLise  it  deals  with  the  least 
significant  portion  of  Walpole’s  life. 

The  matching  problems  afford  a  very  broad  field  for 
good  questions.  Perhaps  there  is  no  other  type  of  examination 
question  that  is  so  effective  in  stimulating  thought.  Care¬ 
fully  planned  problems  were  submitted  on  this  particular  test. 
The  events  listed  in  the  first  part  of  the  test  are  all  of 
considerable  historical  importance.  Th©  same  may  be  said  of 
the  dates,  except  for  the  year  1538.  Nothing  of  importance,  so 
far  at  least  as  the  text  Is  concerned,  happened  in  that  year. 
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With  regard  to  the  provisions  of  Acts  or  Treaties 
there  should  be  more  options  in  order  to  eliminate  the  possi¬ 
bility  of  guessing.  The  same  criticism  applies  to  the  remain 
ing  parts  of  the  matching  problems  and  possibly  serves  to 
explain  the  high  scores  made  by  the  pupils  on  this  test .  The 
actual  names  and  facts  listed  were  exceedingly  well  chosen. 


- 
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CHAPTER  IV 

DISTRIBUTION  OP  QUESTIONS 

Whether  the  Departmental  test  or  the  objective  test 
was  valid  can  be  ascertained,  to  a  certain  extent  at  least,  by 
finding  out  whether  the  various  items  appearing  on  either 
paper  covered  the  History  course  thoroughly  or  whether  they 
covered  hut  a  small  portion  of  it. 

In  order  to  check  the  validity  of  the  various  tests 
from  the  standpoint  of  covering  the  text  in  a  reasonably 
satisfactory  manner  the  following  devices  were  adopted.  All 
the  points  in  the  History  text  that  seemed  sufficiently 
important  to  warrant  their  appearance  on  any  form  of  examina¬ 
tion  were  listed  in  order.  For  convenience,  these  points 
were  grouped  under  the  sovereigns  to  whose  reigns  they  per¬ 
tained.  The  period  subsequent  to  Victoria’s  reign  has  been 
termed  the  Post -Victorian  Period.  This  method,  obviously, 
has  its  limitations  as  no  two  teachers  would  agree  as  to  the 
exact  points  that  should  he  chosen,  or  as  to  the  length  to 
which  subdivision  of  points  should  be  carried.  However,  the 
same  yardstick  was  applied  to  Departmental  and  objective 
tests  alike  . 

The  next  procedure  was  to  find  out  what  points  to 
each  reign,  and  how  many  of  these  points,  were  tested  by 
either  form  of  examination.  Some  items  were  considered  use¬ 
less,  while  others  were  too  indefinite  to  classify.  Such  were 
omitted.  This  fact  explains  why  the  totals  shown  in  the 
tabular  summary  do  not  always  correspond  with  the  totals  in  the 


* 
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examination  papers.  By  cheeking  off  each  point  as  it  appeared 
on  either  examination  it  was  easy  to  discover  what  points  had 
been  tested,  how  often  each  had  been  tested,  and  what  points, 
if  any,  had  been  omitted  from  any  or  all  of  the  tests.  This 
information,  in  tabular  form,  appears  presently. 

The  next  step  was  to  count  the  number  of  pages  of  the 
text  that  were  devoted  to  each  reign,  always  omitting  such 
sections  as  were  not  required  by  the  course  of  studies.  This 
was  done  to  estimate  what  relation,  if  any,  existed  between 
the  number  of  pages,  the  number  of  points,  and  the  number  of 
examination  questions. 

As  a  double  check  the  points  already  mentioned  were 
grouped  into  periods:  Tudor,  Stuart,  etc.  This  second 
arrangement  of  material  should  afford  a  very  valuable  check 
upon  the  first .  If  the  implications  of  the  one  summary 
confirm  those  of  the  other,  then  such  implications  should  be 
reasonably  correct.  The  summaries  follow  immediately. 


.  u:  ' 
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TABLE  i 

STATISTICAL  ANALYSIS 
OF  DEPARTMENT ALS  AND  OBJECTIVE  TESTS 


REIGN 

I 

II 

III 

IV 

TOTALS 

POINTS 

PAGES 

OMIS¬ 

SIONS 

PAPER 

1 

Henry  VII 

2 

2 

1 

5 

5 

12 

2 

1 

Henry  VIII 

1 

- 

3 

- 

4 

3 

17 

«. 

a 

Edward  VI 

- 

- 

- 

am 

- 

3 

6 

3 

Mary 

- 

4 

- 

- 

4 

3 

6 

2 

Elizabeth 

1 

3 

1 

5 

10 

14 

46 

6 

2 

James  I 

1 

- 

- 

1 

2 

4 

9 

3 

a. 

Charles  I 

1 

2 

1 

4 

8 

9 

25 

3 

8 

Cromwell 

3 

- 

am 

1 

4 

4 

14 

1 

m 

Charles  II 

3 

- 

- 

3 

6 

5 

14 

2 

0 

James  II 

1 

- 

1 

2 

4 

5 

10 

2 

5 

W.  &  M. 

1 

- 

2 

1 

4 

3 

7 

2 

«. 

Anne 

- 

4 

1 

5 

10 

5 

14 

2 

1 

George  I 

2 

am 

1 

1 

4 

5 

11 

4 

m 

George  II 

- 

6 

1 

1 

8 

6 

26 

4 

3 

George  III 

9 

2 

1 

7 

19 

16 

40 

5 

1 

George  IV 

1 

3 

1 

2 

7 

8 

8 

3 

2 

William  IV 

- 

- 

• 

2 

2 

4 

7 

1 

« 

Victoria 

6 

3 

2 

5 

16 

27 

105 

14 

8 

Post -Victoria 

1 

8 

- 

7 

15 

25 

63 

16 

- 

TOTALS 

33 

35 

17 

48 

133 

154 

440 

75 

25 

Explanations  of  headings  on  the  above  chart  are: 

1.  I  refers  to  Part  1  of  the  objective  test. 

2.  II,  III  and  IV  refer  to  the  other  parts  of  the 
objective  test. 

3.  "Totals’*  at  the  top  of  the  chart,  refers  to  the 
number  of  questions  asked  on  any  reign  by  all  four  parts  of 
the  objective  test. 

4.  "Points”  refers  to  the  number  of  points  in  all 
four  tests  listed  in  each  reign  from  the  text -book. 

5*  " Pages"  refers  to  the  number  of  pages  the  text 
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devotes  to  each  reign. 

6.  "Omissions”  refers  to  the  number  of  points  that 
were  not  tested  by  any  questions.  The  same  points  may  be 
tested  more  than  once.  Hence  there  may  be  omissions,  though 
totals  and  points  in  the  chart  appear  to  be  equal. 

7.  "Paper  1"  refers  to  the  number  of  points  covered 
by  the  Departmental  Examinations. 


TABLE  II 

ANALYSIS  BY  PERIODS 


PERIOD 

I 

II 

III 

IV 

TOTALS 

POINTS 

PAGES 

OMIS¬ 

SIONS 

PAPER 

1 

Tudor 

4 

7 

6 

6 

23 

28 

87 

13 

3 

Stuart 

10 

6 

5 

17 

38 

35 

93 

15 

8 

Hanoverian 

12 

11 

4 

13 

40 

39 

92 

17 

6 

Victorian 

6 

3 

2 

5 

16 

27 

105 

14 

8 

Post -Victorian 

1 

8 

- 

7 

16 

25 

63 

16 

- 

TOTALS 

33 

35 

17 

48 

133 

154 

440 

75 

25 

The  explanations  of  the  headings  are  the  same  as  those 
for  Table  I. 

The  above  tables  yield  valuable  evidence  concerning 
the  nature  of  the  distribution  of  test  questions.  In  this 
respect  they  prove  conclusively  that  the  Departmental  was  very 
faulty,  because : 

1.  Half  of  the  reigns  were  not  tested  at  all. 

2.  The  essay  questions  were  very  unevenly  distributed 
either  by  reigns  or  by  periods.  Aboxit  30$  of  the  points  in 
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Victoria*  s  reign  were  tested.  On  the  other  hand  only  8$  ©f 
the  points  in  George  III*s  reign  were  tested. 

3.  Only  one  “-sixth  of  the  entire  number  of  points 
were  tested  by  the  essay  examination. 

4.  Table  I  serves  to  indicate  at  a  glance  that,  as 
far  as  the  Department a Is  were  concerned,  the  omissions  were 
so  numerous  that  it  was  not  worth  while  noting  them  down® 

5.  Table  II,  dealing  with  the  summary  by  periods, 
shows  that  twice  as  many  points  were  covered  in  the  Stuart 
era  as  in  the  Tudor  era.  The  same  table  shows  that  no  points 
were  tested  in  one  period.  The  highest  number  of  points 
tested  for  any  one  period  was  not  more  than  30$  of  the  total 
possible  number  of  points. 

6.  The  Post -Victorian  period  was  not  tested  at  all. 

7.  Pupils  were  required  to  write  on  about  half  of 
the  essay  questions.  They  therefore  wrote  on  a  very  small 
proportion  of  the  total  number  of  points. 

Such  evidence  should  serve  to  make  clear  the  extreme 
difficulty  of  testing  a  History  course  with  any  degree  of 
thoroughness  by  means  of  an  essay  test .  To  state  a  hypo¬ 
thetical  case,  a  lucky  pupil  might  have  studied  less  than 
one -fifth  or  one -sixth  of  the  course  and  yet  might  make 
100$  on  this  particular  paper  or  on  any  other  paper  of  a 
similar  nature . 

The  situation  is  very  different,  however,  when  we 
consider  the  tables  as  applied  to  the  objective  tests. 

Each  type  of  these  tests  will  be  considered  it  its  turn. 
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1.  The  True-False  Test.  Most  of  the  reigns  are 
tested  in  part  at  least.  There  are,  however,  nine  times 
as  many  questions  on  George  111*3  reign  as  there  are  on 
Elizabeth* s  reign.  The  tables  on  the  other  hand  indicate 
that  the  text  devotes  practically  equal  attention  to  either 
reign  as  far  as  the  number  of  pages  is  concerned.  They  also 
indicate  that  the  number  of  points  in  each  reign  is  much 
the  same.  Each  reign,  therefore,  should  be  tested  by 
approximately  the  same  number  of  questions. 

2.  The  Completion  Test.  The  tables  indicate  that 
some  reigns  are  over -emphasized  while  other  reigns  remain 
untested.  Table  II  shows  that  when  the  test  items  are 
summed  up  by  periods  the  distribution  is  considerably 
improved,  except  for  the  Post -Victorian  period. 

3.  The  Multiple  Choice  Test.  The  questions  on 
this  test  are  so  well  distributed  that  there  is  very  little 
to  offer  by  way  of  criticism.  However,  according  to  the 
tables,  several  important  reigns  are  entirely  omitted. 

4.  The  Matching  Tests.  Considering  the  oppor¬ 
tunities  for  a  good  distribution  the  tables  indicate  rather 
disappointing  results.  Queen  Elizabeths  reign,  for  in¬ 
stance,  has  five  items  assigned  to  it.  On  the  other  hand 
the  total  pre -Elizabethan  period  is  covered  by  one  single 
question.  It  may  further  be  noticed  from  Table  II  that 
thirty  out  of  forty-eight  points  covered  are  to  be  found 

in  two  periods,  that  is  in  less  than  half  the  total  number 
of  periods . 
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5.  The  objective  test  as  a  whole,  however,  reveals 
very  clearly  its  superiority  over  the  essay  or  Departmental 
test.  A  glance  at  either  table  discloses  an  apparently  high 
degree  of  correspondence  between  the  distribution  of  items  in 
the  objective  test  and  the  distribution  of  items  throughout 
the  several  parts  of  the  text.  Omissions  also  are  well  dig- 
tributed.  On  the  other  hand,  neither  the  inclusion  nor 
omission  of  items  in  the  Departmental  paper  bears  any  con¬ 
sistent  relationship  to  the  distribution  of  important  topics 
in  the  text . 

There  are  two  main  conclusions  to  be  drawn  from  this 
discussion  of  the  tables.  The  first  of  these  is  that  while 
certain  sections  of  the  objective  test  were  not  as  well  dis¬ 
tributed  as  they  might  have  been,  the  questions  on  the 

objective  test  as  a  whole  were  very  well  distributed  through¬ 
out  the  course  .  To  this  extent  the  new  type  paper  was 
certainly  a  most  valid  test  of  the  pupils  knowledge  of 
History.  The  essay  test  on  the  other  hand  made  no  attempt 

to  cover  the  text.  Since  a  test  that  covered  100$  of  the 

points  in  the  text  would  be  100$  valid  it  can  easily  be  seen 
that  the  objective  test  approaches  much  closer  to  this  100$ 
validity  than  does  the  Departmental  examination. 


c 
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CHAPTER  ¥ 


CORRELATIONS  BETWEEN  OBJECTIVE  TESTS 
AND  DEPARTMENTAL  EXAMINATIONS 

Whether  or  not  object iv@  tests  can  safely  be  sub¬ 
stituted  for  Department a Is  must  depend,  to  a  certain  extent 
at  least,  on  whether  the  marks  made  by  the  pupils  on  the 
objective  tests  correlate  reasonably  well  with  the  marks 
made  on  the  Departmental  .  No  assumption  is  being  made  that 
the  Departmental  marks  constitute  an  infallible  standard. 

The  question  under  discussion  is  whether  the  objective  tests 
do  test  whatever  type  of  knowledge  or  reasoning  power  is 
tested  by  the  Departmentals . 

What  constitutes  a  reasonable  coefficient  of  corre¬ 
lation  between  two  sets  of  marks?  Opinions  may  differ  but 
Ruch  adopts  the  following  standards: 

Correlations  of  0  -  0.25  are  insignificant. 

Correlations  of  0.25  -  0.50  are  low. 

Correlations  of  0.50  -  0.80  are  fairly  significant. 

Correlations  of  0.80  -•  0.95  are  fairly  high. 

Correlations  of  0.95  -  1.00  are  high.^- 

Using  these  standards  it  should  be  possible  to 
estimate  fairly  closely  the  significance  of  each  of  the 
various  correlations  appearing  on  the  Ruch  and  Stoddard 
sheets.  These  correlations  appear  on  Table  III.  Abbrevia¬ 
tions  are  used  such  as  D  for  Departmental,  O.T.  for  objective 
test,  M  for  matching,  and  O.T.-  for  the  total  test  less  the 
sub -test  for  the  moment  under  comparison. 


XRuch ,  G.M.  Objective  or  New  Type  Examinations,  Page  90. 
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TABLE  111 

COEFFICIENTS  OF  CORRELATIONS  (FROM  SHEETS) 


Cor¬ 

relations 


Series  I  Series  II  Series  III  Series  IV  Series  V 


PD:T  .F. 

.419 

± 

.028 

.456 

+ 

.027  .609 

+ 

.021  .414 

± 

.028 

.355 

± 

.029 

rD;C  . 

.462 

+ 

.027 

.579 

+ 

.022  .629 

+ 

.020  .499 

4- 

.025 

.473 

4 

.026 

rD;M.C  . 

.451 

4 

.0268 

.432 

+ 

.027  .419 

+ 

.028  .309 

4 

.03 

.382 

4 

.029 

.464 

+ 

.026 

.587 

+ 

.025  .535 

+ 

.024  .514 

4 

.025 

.496 

4 

.025 

PD;O.T  . 

.531 

.024 

.640 

+ 

.019  .583 

4 

.022  .577 

4 

.022 

.52 

4 

.025 

PT  ;f.o.t  .- 

.599 

+ 

.025 

.650 

+ 

.019  .657 

4- 

.019  .578 

4 

.022 

.581 

4 

.022 

rC  :0.T  .- 

.726 

+ 

.016 

.597 

+ 

.022  .732 

+ 

.016  .666 

4 

.019 

.737 

4 

.015 

PM  ;C  :  0  .T  . 

.637 

+ 

.020 

.599 

+ 

.022  .585 

4- 

.022  .59 

4 

.022 

.610 

4 

.021 

PM:0.T  .- 

.647 

4 

.019 

.635 

+ 

.020  .659 

+ 

.019  .619 

4 

.021 

.669 

4 

,019 

The  next  step  Is  to  estimate  the  significance  of  each  of 
these  correlations  on  the  basis  of  the  Ruch  standards  quoted 
previously . 

1.  The  correlations  between  the  Department als  and  the  true- 
false  marks  are  with  one  exception  "low11 .  That  exception  occurs 
in  the  case  of  Series  III,  but  even  here  the  correlation  can  be 
said  to  be  only  "fairly  significant".  All  of  which  would  appear 
to  drive  home  the  conclusion  that,  if  Departmental  examinations 
are  for  the  time  being  to  be  regarded  as  the  criterion,  then 
true -false  tests  do  not  measure  accurately  whatever  It  is  that 
-Jbhe  Department  a  Is  measure.  Possibly  had  there  been  one  hundred 
items  on  the  true -false  test  the  results  would  have  been 


different . 


* 


„ 


. 
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2.  The  correlations  between  the  results  of  the  Depart- 
mentals  and  the  completion  tests  are  more  significant.  They 
vary  from  "low"  to  "fairly  significant"  throughout.  They  are 
"fairly  significant"  in  three  series,  however,  whereas  the 
correlations  between  the  true -false  and  Departmental  are  only 
"significant"  in  one  series.  Completion  problems,  then,  are 

a  better  substitute  for  Departmental,?  than  the  true -false 
tests  are . 

3.  The  correlations  between  the  multiple  choice  problems 
and  the  regular  Departmental  are  very  disappointing.  Table 
III  shows  all  five  series  and  in  each  series  the  correlation 
is  "low".  In  fact,  these  same  problems  test  what  the 
Departmental  test  to  a  smaller  extent  than  does  any  other 
type  of  objective  test. 

4.  The  correlations  between  the  marks  made  by  the  pupils 
on  the  matching  tests  and  those  made  on  the  Departmental?  are 
very  similar  to  the  correlations  between  the  marks  on  the 
completion  tests  and  the  marks  on  the  Department a Is .  As  far 
as  correlations  with  essay  papers  are  concerned  matching 
problems  seem  to  have  much  the  same  value  as  completion  pro¬ 
blems  . 

5.  The  correlations  between  the  objective  test  as  a 
whole  and  the  Departmental  is  so  high  as  to  be  invariably 
"fairly  significant".  This  fact  seems  to  suggest  that  what¬ 
ever  may  be  the  faults  of  any  particular  part  of  the  objective 
test,  such  faults  tend  to  disappear  when  several  types  of 
tests  are  used.  Further,  it  would  appear  that  if  several 


. 

♦ 


. 
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groups  of  objective  tests  are  used,  such  tests  would  constitute 
no  grave  injustice  to  the  student  body  as  a  whole.  On  the 
other  hand  one  can  hardly  help  wondering  why  the  correlations 
are  not  somewhat  higher.  Had  they  varied  from  .70  to  .80 
instead  of  from  .52  to  .64,  there  would  be  less  tendency  to 
doubt  the  wisdom  of  adopting  the  new  type  examinations  in  toto. 
Possibly,  however,  the  Departmentals  themselves  are  the  cause 
of  the  trouble . 

6.  In  general  it  may  be  said  that  as  far  as  the  cor¬ 
relations  between  each  part  of  the  objective  test  and  the 
rest  of  the  objective  test  are  concerned  there  seems  to  be 
less  variation  compared  with  the  correlations  already  dis¬ 
cussed.  In  every  case  they  are  "fairly  significant".  In  other 
words  each  section  of  the  objective  test  correlates  reasonably 
well  with  the  other  three  portions  of  the  test.  To  state  the 
matter  in  another  way:  if  the  objective  test  is  to  be  re¬ 
garded  as  a  good  test  of  history  then  each  of  its  parts  is 
likewise  a  reasonably  good  test . 

Whether  we  rank  each  type  of  objective  test  from  the 
standpoint  of  its  correlation  with  the  rest  of  the  objective 
test  or  from  that  of  its  correlation  with  the  Departmentals 
the  order  is  as  follows : 

| 

(1)  Completion  Tests. 

(2)  Matching  Tests  . 

(3)  True-False  Tests. 

(4)  Multiple  Choice  Tests. 

Apparently  an  examination  composed  of  the  first  two 


t 
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tests  enumerated  above  would  be  a  better  test  than  one  com¬ 
posed  of  all  four  tests.  Such  a  conclusion  may  be  rather 
premature.  It  is  possible  that  under  different  conditions  the 
true  -false  tests  and  the  multiple  choice  tests  might  have 
ranked  higher,  but  it  must  be  remembered  that  the  true -false 
tests  were  given  about  the  same  space  on  the  examination  as 
the  completion  tests.  Would  it  not  be  wise  to  experiment 
with  other  types  of  objective  test  such  as  the  simple  recall 
tests,  map  tests,  or  others?  Obviously  an  examination  com¬ 
posed  entirely  of  true -false  and  multiple  choice  problems 
would  have  relatively  small  validity  when  compared  with  the 
Departmental  or  with  the  other  parts  of  the  objective  test. 


- 
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CHAPTER  VI 

THE  AVERAGE  MARKS  OR  MEANS 
TABLE  IV 

ABSTRACT  OF  MEANS 


Test 

Means 

Series  I  Series  II  Series  III  Series  IV 

Series  V 

Dept . 

60.05 

+ 

.55 

57.46 

+ 

.61 

55.08 

+ 

,59 

52.33 

4 

,51 

52.41 

± 

.55 

T  .F. 

16.06 

+ 

.25 

15.65 

+ 

.26 

14.67 

4 

.26 

14.79 

4 

.23 

14.65 

4 

.24 

O.T  .  -T  .F. 

67.41 

+ 

.48 

65.20 

+ 

,51 

64.63 

4 

,51 

61.38 

4 

,47 

63  .89 

4 

.47 

C. 

23.27 

+ 

.19 

22.61 

■+ 

,21 

21.72 

4 

,21 

21.48 

4 

.20 

21.55 

4 

.20 

O.T.-C  . 

60.20 

+ 

.51 

58.50 

+ 

,54 

58.65 

4 

.54 

57.13 

4 

.49 

57.35 

4 

.48 

M.C  . 

11.59 

+ 

.08 

11.53 

+ 

.07 

11.52 

4 

.09 

11.28 

4 

,08 

11 .28 

4 

.07 

O.T.-M.C  . 

71.29 

+ 

.62 

71.86 

+ 

.67 

67.64 

4 

.67 

66.90 

4 

.59 

77.04 

4 

.59 

Mt 

33.10 

+ 

.27 

31.85 

+ 

.29 

32  .05 

4 

.28 

31.42 

4 

,27 

31.48 

4 

.16 

0  .T  .  -Mt 

50.58 

+ 

.45 

52.04 

+ 

.50 

47.69 

4 

.50 

47.26 

4 

.43 

47.25 

4 

.43 

O.T. 

83  .03 

+ 

.66 

80.78 

+ 

.70 

79  .16 

4 

.72 

78.16 

4 

.64 

78.24 

4 

.64 

In  the  above  table  Dept,  is  the  mean  of  the  Departmentals , 
T.F.  is  the  mean  for  the  true -false  tests,  O.T.-T.F.  is  the  mean 
mark  for  the  total  objective  less  the  true-false  test.  So,  too, 
the  remaining  parts  of  the  objective  test  are  referred  to  by 

their  initial  or  initials. 

Any  discussion  of  the  mean  on  any  test  must  of  necessity 
be  more  or  less  subjective,  because  no  perfect  mean  has  been 
discovered  for  any  subject.  Perhaps,  however,  very  few  teachers 
would  disagree  with  the  following  statement :  a  mean  below  50 % 
is  too  low,*  a  mean  above  10%  is  too  high. 

The  Departmental  mean  expressed  in  percentages  varies. 


, 


. 
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as  may  be  seen  from  Table  IV,  from  52$  -  60 $  (to  the  nearest 
whole  number)  .  The  objective  test  mean  varies  from  60$  - 
63$.  This  last  mean  seems  highly  satisfactory.  It  is  more 
uniform  than  the  Departmental  mean,  and  it  is  almost  exactly 
half  way  between  50$  and  70$.* 

The  true -false  mean  varies  from  approximately  42$  to 
45$,  which  is  unreasonably  low.  The  completion  mean,  63$  - 
68$,  is  very  much  the  same  as  the  mean  for  the  entire  objective 
test.  The  multiple  choice  and  matching  means  are  practically 
always  above  70$.  They  are  therefore  somewhat  high  if  the 
criterion  already  mentioned  is  to  be  accepted. 

The  discussion  of  the  means  reveals  three  important 

fact  s  : 

1.  The  mean  for  the  whole  objective  test  approximates 
the  mean  for  the  Departmentals  but  it  is  more  uniform  in  each 
of  the  five  series . 

2.  The  mean  for  the  completion  problems  is  also  satis¬ 
factory  . 

3.  The  means  for  the  multiple  choice  and  matching  tests 
are  so  similar  and  the  mean  for  the  true -false  test  is  so 
low  that  it  is  difficult  to  rank  these  three  tests  from  the 
standpoint  of  the  mean. 


*  The  means  shown  in  Table  IV  are  in  terms  of  row 
scores.  The  total  possible  score  on  the  objective  test  was 
130  points . 
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CHAPTER  VII 

FAILURES  AND  HIGH  MARES 


Authorities  contemplating  the  introduction  of  objec¬ 
tive  tests  would  naturally  b©  interested  in,  the  percentage  of 
failures  and  of  high  marks  on  such  tests. 

It  is  rather  difficult  to  say  just  what  would  con¬ 
stitute  a  reasonable  number  of  failures  in  any  high  school 
subject .  The  average  percentage  of  failures  on  twenty-four 
subjects  of  the  High  School  Curriculum  in  the  year  1933  was 
approximately  25$.  Possibly,  then,  it  may  be  assumed  any 
examination  of  an  unselected  group  of  pupils  should  fail 
approximately  25$  of  the  total  number  of  pupils. 

As  far  as  high  marks  are  concerned  teachers  are 
skeptical  of  the  value  of  any  examination  which  ranks  a  large 
percentage  of  pupils  between  90$  and  100$. 

Table  V  below  shows  exactly  what  happened  in  the  case 
of  the  1931  History  paper  from  the  standpoint  just  mentioned. 

TABLE  V 

PERCENTAGES  OF  FAILURES  AND  OF  MARKS  ABOVE  90$ 


Test 

Failures  0  -  49$ 

High  Marks  90  -  100$ 

Department a Is 

32.55$ 

1.20$ 

Completion 

24.20$ 

2  .90$ 

Multiple  Choice 

4.75$ 

7.45$ 

True -False 

63.70$ 

.25$ 

Matching 

15 . 50$ 

15.35$ 

Objective  Test 

23.50$ 

1.36$ 
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Prom  the  standpoint  of  the  percentages  of  failures  in 
each  test  the  following  remarks  are  pertinent: 

1.  The  essay  or  Departmental  test  failed  too  many  pupils, 
if  25$  is  to  he  accepted  as  the  standard.  On  the  other  hand 
the  objective  test  failed  exactly  or  almost  exactly  the  right 
number  of  students.  Evidently  the  objective  test  in  this 
respect  must  be  considered  as  practically  a  perfect  test. 

There  seems  to  be  little  room  for  doubt  that  since  the  objec¬ 
tive  test  covers  a  wide  range  of  know ledge  the  percentage  of 
failures  would  be  reasonably  constant  from  year  to  year, 
whereas  the  number  of  failures  in  the  Department a Is  varies 
immensely . 

2.  The  various  parts  of  the  objective  test  present  wide 
ranges  in  the  number  of  failures.  The  completion  test  failed 
the  correct  number.  The  matching  test  failed  a  reasonable 
number.  The  remaining  tests,  however,  were  either  too  easy 
or  too  hard.  Teachers  are  just  as  suspicious  of  an  examina¬ 
tion  which  fails  too  many  pupils  as  they  are  of  an  examination 
which  passes  too  many  pupils .  Again  it  is  seen  that  the 
multiple  choice  and  the  true -false  tests  must  be  ranked  at 
the  bottom  of  the  list  of  tests. 

When  the  high  marks  from  90$  to  100$  are  taken  into 
consideration,  it  may  he  noticed  that: 

1.  The  objective  test  and  the  Departmentals  have  almost 

the  same  number  of  high  marks . 

2.  There  is  a  wide  variation,  however,  in  the  number  of 
high  marks  to  be  found  on  the  various  parts  of  the  objective 
test.  The  completion  test  again  must  rank  at  the  top  of  the  list. 


■ 
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CHAPTER  VIII. 

PECULIAR  FEATURES  OF  RESULTS 

There  are  several  very  peculiar  features  of  the  marks 
made  by  the  pupils  on  the  various  tests  .  One  of  these  is  the 
feet  that  many  pupils  failed  on  the  objective  test  yet  made 
high  marks  on  the  essay  test,  or  vice  versa  ,  Perhaps  had  they 
written  two  essay  tests  the  same  situation  would  have  arisen. 
Possibly  a  pupil  who  had  crammed  a  few  answers  to  the  old- 
fashioned  tests  might  have  been  lucky  in  uhittingu  the  questions 
that  actually  appeared  on  the  essay  paper.  Such  a  pupil,  having 
no  real  knowledge  of  History,  would  naturally  fall  down  on  the 
objective  test.  On  the  other  hand  a  pupil  who  knew  considerable 
History,  but  who  did  not  know  how  to  organize  it,  might  easily 
fail  in  the  Departmental  examination  and  yet  secure  high  marks 
on  the  objective  test.  Yet  it  is  hard  to  believe  that  such 
explanations  would  explain  the  fact  that  a  pupil  made  10%  on 
one  examination  and  Q0%  on  the  other.  Is  it  possible  that  the 
two  types  of  examinations  measure  abilities  which  differ  quite 
w i de ly ? 

The  second  point  to  be  considered  will  certainly  not 
throw  much  light  on  the  situation.  Before  coming  to  this  point 
a  word  of  explanation  is  necessary.  It  has  already  been 
pointed  out  that  the  two  thousand  pupils  whose  marks  are  con¬ 
sidered  in  this  thesis  were  divided  into  five  series  of  four 
hundred  cases  each.  The  first  three  series  dealt  with 
ordinary  second  year  pupils.  The  last  two  series,  however,  re¬ 
presented  pupils  who  were  in  their  third  year  of  High  School 


. 
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and  who  were  on  the  average  possibly  one  year  older  than  the 
pupils  of  the  other  groups . 

Reference  to  Table  IV  will  show  that  the  first  three 
groups  did  -uniformly  better  work  on  the  Department  a  Is  than 
the  other  groups  *  The  same  situation  was  true  in  the  case 
of  the  objective  tests.  But  whereas  the  range  of  marks  in 
favor  of  the  younger  pupils  was  about  Q%  in  the  case  of  the 
Departmental ,  it  was  less  than  3%  in  so  far  as  the  objective 
test  was  concerned.  This  fact  seems  to  suggest  that  the  older 
students  did  relatively  better  work  on  the  objective  tests. 

Why  should  the  older  pupils  succeed  relatively  better 
on  the  objective  tests?  It  is  very  hard  to  say.  On  the 
other  hand  the  point  must  be  noted  because  if  it  is  always 
true  that  the  older  pupil  does  better  work  on  the  objective 
test  then  it  is  obvious  that  something  besides  historical 
knowledge  must  be  tested  by  the  new  type  examinations.  What 
the  something  may  be,  if  it  exists  at  all,  is  a  matter  that 
must  be  left  for  further  investigation. 


. 
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CHAPTER  IX 

DISTRIBUTION  OP  MARKS 
TABLE  VI 

STANDARD  DEVIATIONS 


Test 
S.D. »s 

Series  I 

Series 

II 

Series 

III 

Series 

IV 

Series  V 

Dept . 

16.30 

1  .39 

18.00 

+ 

.43 

17.50 

+ 

.42 

15.10 

+ 

.36 

16.20 

1  .39 

T.F. 

7.44 

1  .18 

7  .62 

+ 

.18 

7.84 

+ 

.19 

6  .82 

,16 

7.02 

1  .17 

O.T.-T.P. 

14.15 

1  .34 

15.10 

+ 

.36 

15 . 15 

+ 

.36 

14.05 

+ 

.33 

13.95 

t  .33 

G  . 

5,70 

i  .14 

6.24 

■+ 

.15 

6  .26 

.15 

5,80 

+ 

.14 

5  .90 

i  .14 

0  .T  .  -C  . 

15.20 

t  .36 

16.15 

+ 

.38 

16.15 

+ 

.38 

14.55 

+ 

.35 

14.25 

f  .34 

M.C  . 

2.26 

i  .05 

2.19 

+ 

.05 

2.56 

+ 

.06 

2  .35 

.06 

2  .15 

±  .05 

O.T  .  — M  .0  . 

18.30 

t  .43 

19.90 

.47 

19  ,75 

.47 

17.40 

+ 

.41 

17.60 

±  .42 

Mt 

8.06 

±  .19 

8.58 

+ 

.20 

8.44 

+ 

.20 

8.12 

+ 

.  19 

7.64 

±  .18 

0  .T .  -Mt 

13  .30 

±  .32 

14.85 

+ 

.35 

14.95 

+ 

.36 

12  .80 

+ 

.30 

12  .85 

f  .31 

O.T. 

19.70 

1  .47 

20  .90 

.50 

21.35 

+ 

.51 

18.85 

+ 

.45 

19  .00 

± .45 

In  the  above  table  T.F.  refers  to  the  true -false  test. 
O.T. -T.F.  refers  to  what  is  left  of  the  objective  test  after 
the  marks  on  the  true -false  test  have  been  deducted.  O.T.  refers 
to  the  objective  test  as  a  whole. 

The  standard  deviation  of  the  objective  test  ae  a 
whole,  when  reduced  to  terms  of  percentages,  Is  very  much  the 
same  as  that  of  the  Department als .  Likewise  the  standard 
deviation  of  the  completion  and  matching  tests  approximates  that 
of  either  the  whole  objective  test  or  the  Departmental ,  It  may 
be  rather  significant  that  the  standard  deviation  of  the  true- 
false  tests  deviates  quite  widely  from  the  other  standard 
deviations.  None  of  the  crlterions  hitherto  adopted  seem  to 


favor  the  true -false  tests. 
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CHAFTER  X 

DISTRIBUTION  OF  MARKS  (CQNT*D) 

The  distribution  of  the  entire  number  of  marks,  two 
thousand  in  all,  is  illustrated  graphically  in  the  accompany¬ 
ing  diagrams  .  The  nine  figures  enable  comparisons  to  be  made 
between  each  part  of  the  objective  test  and  the  Departmentals , 
between  each  part  of  the  objective  test  and  the  objective 
test  as  a  whole,  and  lastly,  between  the  Departmentals  and 
the  objective  test  as  a  whole.  In  the  figures,  which  Inci¬ 
dentally  are  all  drawn  to  the  same  scale,  the  distribution  of 
the  Departmentals  is  shown  in  red  ink  when  the  various  parts 
of  the  objective  test  or  the  objective  test  as  a  whole  are 
being  compared  with  it .  When  the  objective  test  is  used  as 
the  basis  of  comparison  it  is  shown  in  red  Ink,  Abbreviations 
in  the  legend  are : 


D.  = 

Departmentals 

O.T .  = 

Objective  Test 

T  .F.  = 

True -False 

C.  = 

Completion 

M.C’.  = 

Multiple  Choice 

M.  - 

Matching 

Figure  1  illustrates  the  distribution  of  Departmental 
and  the  true -false  scores.  Neither  of  these  distributions 
can  be  said  to  be  satisfactory.  The  Departmental  graph  shows 
a  deep  depression  -  from  about  43$  to  49$  -  with  a  correspond 
ing  peak  -  from  50$  to  56$.  It  is  worth  while  noticing  that 
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the  depression  and  the  peak  are  almost  identical  in  size. 

These  two  irregularities  are  due  to  the  fact  that  the  Pro¬ 
vincial  examiners  are  anxious  to  pass  as  many  as  possible  of 
those  pupils  who  make  about  44$  -  49$  on  any  examination. 

This  fact  accounts  for  the  relatively  low  number  of  marks 
between  45$  and  49$.  But  these  marks ,  that  is  to  say  the 
marks  that  the  examiner  deliberately  either  raises  or  lowers ? 
must  appear  elsewhere.  They  do  appear  in  the  50$  -  55$ 
group,  where,  together  with  the  marks  that  might  normally  be 
expected  to  appear  in  this  group,  they  serve  to  destroy  the 
symmetry  of  the  normal  curve.  Since,  however,  this  is  due  to 
a  wholly  artificial  procedure,  the  Departmental  examination 
can  hardly  be  expected  to  assume  the  blame  for  this  parti¬ 
cular  irregularity.  It  is  further  to  be  noted  that  since  the 
peak  and  the  depression  are  equal  in  size,  if  the  peak  could, 
so  to  speak,  be  inverted  and  placed  so  as  to  fill  the  de¬ 
pression,  there  would  be  a  graph  showing  remarkable  symmetry. 
Be  all  that  as  it  may,  the  graph  as  it  stands,  shows  a  very 
uneven  distribution  of  marks  between  40$  and  60$. 

Figure  1  also  shows  the  distribution  of '  the  true- 
false  marks.  The  graph  of  these  marks  is  very  much  skewed 
towards  the  left.  A  line  drawn  from  the  highest  point  on 
the  graph  would  reach  the  base  line  at  about  45$.  Further, 
on  the  left  hand  side,  the  graph  never  approaches  the  zero 
mark.  On  the  contrary  it  begins  with  about  105  cases.  Then 
there  is  a  peculiar  dip  to  60  cases.  This  apparently  suggests 
that  there  were  too  many  hard  questions  on  this  test.  The 
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rest  of  the  graph  conforms  reasonably  well  to  the  normal  type 
except  for  the  obvious  fact  that  the  high  marks  end  at  about 

90$. 

A  comparison  between  the  two  graphs  reveals  that  the 
true -false  paper  failed  a  great  many  more  pupils  than  the 
Departmental,  and  that  the  Departmental  graph  is  more  normal 
at  the  extremities,  while  the  true -false  graph  Is  more  normal 

at  the  apex. 

Figure  2  shows  the  distribution  of  the  objective  test 
and  the  true-false  scores.  The  graph  of  the  objective  test 
as  a  whole  is  a  remarkable  one.  It  approaches  the  base  line 
at  either  extremity;  it  never  reaches  the  base  line;  there 
are  neither  hundreds  nor  zeros;  there  are  practically  no 
striking  irregularities;  there  is  but  little  skew.  It  can 
hardly  be  hoped  that  any  examination  will  ever  show  a  better 
distribution  of  marks. 

Figure  2  also  shows  the  true-false  scores.  A  mere 
glance  is  sufficient  to  indicate  how  much  better  is  the 
distribution  of  the  whole  objective  test,  and  how  much  more 
evenly  the  marks  on  the  whole  test  are  distributed  as  between 
passes  and  failures.  It  is  rather  strange  that  the  true- 
false  graph  conforms  to  the  Departmental  graph  almost  as  well 
as  it  does  to  the  objective  test  graph.  Evidently  the  true- 
false  questions  do  not  fit  in  particularly  well  with  any 
type  of  examination. 

Figure  3  shows  the  distribution  of  the  completion 
scores  as  compared  with  the  Departmental  scores.  The 
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distribution  of  the  former  scores  conforms  very  closely  to 
that  shown  by  the  normal  frequency  curve .  It  approaches  the 
base  line  at  either  end;  it  is  symmetrical;  there  is  not  a 
single  dip  throughout.  It  is  obviously  open  to  criticism  on 
the  ground  that  there  are  too  many  high  marks.  However,  had 
there  been  more  questions  this  situation  might  have  remedied 
itself.  It  is  certainly  a  more  symmetrical  distribution  than 
is  to  be  seen  in  the  Departmentals  on  the  same  figure,  but 
the  marks  are  much  higher  and  there  are  more  high  marks  in 
the  case  of  the  completion  problems.  On  the  other  hand,  if 
comparisons  were  made  with  a  Departmental  examination  whose 
marks  had  not  been  '‘boosted'1  at  one  particular  point,  the 
evidence  might  be  considerably  more  in  favor  of  the  Depart¬ 
mentals  . 

Figure  4  compares  the  graphs  of  completion  and 
objective  test  scores.  The  comparison  is  very  satisfactory 
from  both  standpoints.  On  the  left  hand  side  the  lines 
run  almost  parallel.  On  the  right  hand  side  the  same  is 
true.  The  objective  test,  however,  smoothes  out  the  ten¬ 
dency  for  the  marks  to  be  too  high. 

Figure  5  introduces  the  graph  showing  the  distri¬ 
bution  of  the  multiple  choice  scores.  It  is  unsatisfactory 
in  the  extreme.  At  the  left,  for  a  considerable  space,  it 
remains  almost  parallel  to  the  base  .  Then  it  mounts  aloft 
faster  than  Pegasus.  Its  apex  rises  above  that  of  the 
Departmental  graph.  That  graph,  however,  was  shown  to  be 
affected  by  special  considerations.  The  marks  between 
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43  and  55  were  shown  to  be  artificial,  or  at  least  there  was 
the  very  wide  possibility  that  they  were  so.  No  such  expla¬ 
nations  can  be  offered  in  the  case  of  the  multiple  choice  marks. 
The  only  other  solution  is  that  the  multiple  choice  test  was 
very  unsatisfactory  in  one  respect  at  least. 

Figure  6  shows  the  same  multiple  choice  graph  compared 
with  the  objective  test.  The  same  criticisms  as  before  are 
pertinent.  Perhaps  it  compares  slightly  better  with  the 
objective  test  than  with  the  Departmental,  but  the  difference 
is  not  more  than  might  reasonably  be  expected.  All  that  can 
be  said  in  its  favor  is  that  it  is  quite  symmetrical. 

Figure  7  shows  the  distribution  of  the  matching 
scores  as  compared  with  the  Departmental  scores.  The  graph 
is  peculiar.  It  seems  to  be  heavily  skewed  towards  the  right 
and  finally  to  be  more  or  less  suspended  in  mid-air.  S©  at 
least  it  appears  when  it  is  compared  with  the  graph  of  the 
Departmental  scores  . 

Figure  8  reveals  a  different  situation.  On  the  left 
hand  side  at  least  the  graph  of  the  completion  scores  com¬ 
pares  very  favorably  with  the  graph  of  the  objective  test . 

It  is  still  badly  skewed,  and  it  is  still  suspended  in 
mid-air,  but  otherwise  it  compares  fairly  well  with  the 
other  graph. 

Figure  9  shows  the  distribution  of  the  objective 
test  as  compared  with  the  distribution  ol  the  Departmental 
examinations.  Leaving  aside  the  high  peak  of  the  Depart¬ 
mental  graph,  which  has  been  mentioned  before,  the  graphs  are 
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much  more  remarkable  for  their  similarity  than  for  their 
differences.  As  they  stand,  however,  the  objective  test 
yields  the  more  symmetrical  distribution  while  the  Departmen¬ 
tal  graph  possibly  shows  less  "skewing11.  When  no  allowances 
are  made  there  is  no  denying  the  fact  that  the  actual 
objective  test  scores  show  a  much  better  distribution, 
approach  much  closer  to  the  normal  curve  than  do  the  scores 
of  the  Departmental  .  In  fairness  to  the  latter  distribution 
a  question  must  be  asked.  If  the  objective  tests  were 
accepted  as  the  standard  throughout  the  Province  would  pupils 
making  64  marks  out  of  a  possible  total  of  130  marks  be 
allowed  to  fail?  It  is  very  doubtful  if  such  iron  methods 
would  ever  be  introduced.  Then  would  there  be  a  dip  in  the 
objective  test  graph  corresponding  to  the  one  noted  in  the 
Departmental  graph? 

There  is  another  consideration  of  a  different  nature, 
however.  Criticisms  have  been  made  of  the  distribution  of 
marks  on  each  part  of  the  objective  test.  If  graphs  had  been 
constructed  illustrating  the  distribution  of  marks  on  each 
question  of  the  essay  paper,  might  not  like  criticisms  have 
been  applied  with  equal  or  greater  force? 
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CHAPTER  XI 
CONCLUSIONS 

The  conclusions  to  be  -drawn  from  the  foregoing  com¬ 
parisons  of  Departmental  examinations  and  objective  tests  are 

as  follows : 

1.  The  questions  on  the  Departmental  examination  were 
unusual  in  that  they  required  a  detailed  knowledge  of  sub¬ 
jects  often  Inadequately  treated  in  the  text »  The  questions 
on  the  objective  test,  while  satisfactory  on  the  whole, 
sometimes  stressed  unimportant  aspects  of  History,  and  at 
other  times  were  not  well  worded. 

2.  The  questions  on  the  Departmental  examination  covered 
but  a  small  proportion  of  the  Grade  X  History.  The  objective 
test  questions  covered  thoroughly  most  of  the  important 
phases  of  the  course.  Further,  they  were  well  distributed 
from  page  to  page  of  the  text,  from  reign  to  reign  and  from 
period  to  period. 

3.  The  correlations  between  the  Departmental  marks  and 
the  objective  test  marks  were  not  high.  The  most  that  can 

be  said  of  the  highest  of  these  correlations  is  that  they  are 
"fairly  significant".  This  fact  indicates  that  objective 
tests  would  probably  test  quite  different  information  from 
that  listed  by  the  Departmental  .  The  true -false  test  was 
proved  to  be  of  somewhat  doubtful  value  when  compared  with 
either  the  Departmental  or  the  objective  test.  The  four 
parts  of  the  objective  test,  from  the  standpoint  of  cor¬ 
relations  with  either  the  Departmental  or  the  objective  test 
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as  a  whole,  were  ranked  as  follows: 

(1)  Completion 

(2)  Matching 

(3)  True -False 

(4)  Multiple  Choice 

3.  The  average  marks  varied  considerably  from  test  to 
test  but  they  were  practically  the  same  for  the  Departmentals 
and  for  the  whole  objective  test. 

4.  The  objective  test  had  practically  an  ,fidealn  number 
of  failures.  As  far  as  these  were  concerned  it  was  probably 
superior  to  the  Departmentals ,  The  number  of  high  marks  was 
very  much  the  same  on  either  type  of  examination. 

5.  There  were  two  peculiar  features  of  the  examinations. 
In  the  first  place  pupils  frequently  passed  the  Departmentals 
and  failed  on  the  objective  test  and  vice  versa.  This  seemed 
to  indicate  that  the  two  types  of  examinations  do  not  test 
the  same  kind  of  information.  This  supposition  was  strength¬ 
ened  by  the  fact  that  the  objective  test  seemed  to  favor 
older  pupils . 

6.  A  series  of  graphical  illustrations  showed  that  while 
there  were  sometimes  peculiar  distributions  of  marks  on  the 
various  parts  of  the  objective  test,  yet  the  distribution  of 
marks  on  the  objective  test  as  a  whole  was  more  regular  than 
that  of  the  Departmentals . 

7.  On  the  whole,  the  weight  of  evidence  seems  to  suggest 
that  the  objective  test  was  a  more  satisfactory  examination 
than  the  Departmentals .  There  is  no  doubt  but  that  it  would 
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be  very  unwise  to  set  an  objective  test  consisting  of  only 
one  type  of  question.  For  the  same  reason  it  must  be  equally 
unwise  to  include  any  on©  type  of  objective  test  on  a  regular 
Departmental  examination. 
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